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Abstract. We demonstrate a simple greedy algorithm that can reliably recover 

■ a vector v G M d from incomplete and inaccurate measurements x = <$>v + e. Here 
$ is a N x d measurement matrix with N <C d, and e is an error vector. Our 
algorithm, Regularized Orthogonal Matching Pursuit (ROMP), seeks to close the 
gap between two major approaches to sparse recovery. It combines the speed and 

■ ease of implementation of the greedy methods with the strong guarantees of the 
j /^ \ convex programming methods. 

For any measurement matrix $ that satisfies a Uniform Uncertainty Principle, 
ROMP recovers a signal v with 0(n) nonzeros from its inaccurate measurements 
x in at most n iterations, where each iteration amounts to solving a Least Squares 
Problem. The noise level of the recovery is proportional to vlog^-ll e ll 2- In partic- 
ular, if the error term e vanishes the reconstruction is exact. 

This stability result extends naturally to the very accurate recovery of approx- 
J> ■ imately sparse signals. 

o 

CO 



1. Introduction 



o 



1.1. Exact recovery by convex programming. The recent massive work in the 
area of Compressed Sensing, surveyed in [lj, rigorously demonstrated that one can 
algorithmically recover sparse (and, more generally, compressible) signals from in- 
complete observations. The simplest model is a <i-dimensional signal v with a small 
rS I number of nonzeros: 

v E R d , |supp(f)| < n < d. 

Such signals are called n-sparse. We collect iV d nonadaptive linear measurements 
of v, given as x = $t> where $ is some iV by d measurement matrix. We then wish 
to efficiently recover the signal v from its measurements x. 

A necessary and sufficient condition for exact recovery is that the map $ be 
one-to-one on the set of n-sparse vectors. Candes and Tao [1] proved that under 
a stronger (quantitative) condition, the sparse recovery problem is equivalent to a 
convex program 

(1.1) min||n||i subject to $w = x 

and therefore is computationally tractable. This condition is that the map $ is an 
almost isometry on the set of 0(n)-sparse vectors: 
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Definition 1.1 (Restricted Isometry Condition). A measurement matrix $ satisfies 
the Restricted Isometry Condition (RIC) with parameters (m, e) for e G (0, 1) if we 
have 

(1 — £)||f|| 2 < ||$w|| 2 < (1 + e)||v||2 f° r ah wi-sparse vectors. 

Under the Restricted Isometry Condition with parameters (3n, 0.2), the convex 
program (11.11) exactly recovers an n-sparse signal v from its measurements x [I]. 

The Restricted Isometry Condition can be viewed as an abstract form of the Uni- 
form Uncertainty Principle of harmonic analysis ([5], see also [2] and [1Q]). Many 
natural ensembles of random matrices, such as partial Fourier, Bernoulli and Gauss- 
ian, satisfy the Restricted Isometry condition with parameters n > 1, e G (0, 1/2) 
provided that 

N = ne-°^ log° (1) d; 

see e.g. Section 2 of |TT] and the references therein. Therefore, a computationally 
tractable exact recovery of sparse signals is possible with the number of measure- 
ments N roughly proportional to the sparsity level n, which is usually much smaller 
than the dimension d. 

1.2. Exact recovery by greedy algorithms. An important alternative to convex 
programming is greedy algorithms, which have roots in Approximation Theory. A 
greedy algorithm computes the support of v iteratively, at each step finding one or 
more new elements (based on some "greedy" rule) and subtracting their contribution 
from the measurement vector x. The greedy rules vary. The simplest rule is to 
pick a coordinate of $*x of the biggest magnitude; this defines the well known 
greedy algorithm called Orthogonal Matching Pursuit (OMP), known otherwise as 
Orthogonal Greedy Algorithm (OGA) [13] . 

Greedy methods are usually fast and easy to implement, which makes them popu- 
lar with practitioners. For example, OMP needs just n iterations to find the support 
of an n-sparse signal v , and each iteration amounts to solving one least-squares prob- 
lem; so its running time is always polynomial in n, N and d. In contrast, no known 
bounds are known on the running time of (11.11) as a linear program. Future work 
on customization of convex programming solvers for sparse recovery problems may 
change this picture, of course. For more discussion, see [H] and [TT] , 

A variant of OMP was recently found in jpLL] that has guarantees essentially as 
strong as those of convex programming methods^] This greedy algorithm is called 
Regularized Orthogonal Matching Pursuit (ROMP); we state it in Section [L3] below. 
Under the Restricted Isometry Condition with parameters (2n, 0.03/ A/log n), ROMP 
exactly recovers an n-sparse signal v from its measurements x. 

Summarizing, the Uniform Uncertainty Principle is a guarantee for efficient sparse 
recovery; one can provably use either convex programming methods (ll.ip or greedy 
algorithms (ROMP). 



OMP itself does not have such strong guarantees, see [12] . 
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1.3. Stable recovery by convex programming and greedy algorithms. A 

more realistic scenario is where the measurements are inaccurate (e.g. contaminated 
by noise) and the signals are not exactly sparse. In most situations that arise in 
practice, one cannot hope to know the measurement vector x = $t> with arbitrary 
precision. Instead, it is perturbed by a small error vector: x = $t> + e. Here the 
vector e has unknown coordinates as well as unknown magnitude, and it needs not 
be sparse (as all coordinates may be affected by the noise). For a recovery algorithm 
to be stable, it should be able to approximately recover the original signal v from 
these perturbed measurements. 

The stability of convex optimization algorithms for sparse recovery was studied in 
0) [13], [H], Assuming that one knows a bound on the magnitude of the error, 
I < 5, it was shown in [3] that the solution v of the convex program 

(1.2) min||tt||i subject to \\&u — x\\ 2 < 6 

is a good approximation to the unknown signal: \\v — v\\2 < C5. 

In contrast, the stability of greedy algorithms for sparse recovery has not been 
well understood. Numerical evidence [8] suggests that OMP should be less stable 
than the convex program (11. 2p . but no theoretical results have been known in either 
the positive or negative direction. The present paper seeks to remedy this situation. 

We prove that ROMP is as stable as the convex program (11.21) . This result essen- 
tially closes a gap between convex programming and greedy approaches to sparse 
recovery. 

Regularized Orthogonal Matching Pursuit (ROMP) 

Input: Measurement vector x G M. N and sparsity level n 
Output: Index set I C {1, ... , d}, reconstructed vector v — y 

Initialize: Let the index set I = and the residual r = x. 
Repeat the following steps n times or until |/| > 2n: 

Identify: Choose a set J of the n biggest nonzero coordinates in mag- 
nitude of the observation vector u = $*r, or all of its nonzero coor- 
dinates, whichever set is smaller. 
Regularize: Among all subsets Jo C J with comparable coordinates: 

\u(i)\ < 2\u(j)\ for all i,j G J , 

choose Jo with the maximal energy ||w|j ||2- 
Update: Add the set J to the index set: / <— IU Jo, and update the 
residual: 

y = argmin ||x — $^||2! r = x — $?/. 



Theorem 1.2 (Stability under measurement perturbations). Assume a measure- 
ment matrix $ satisfies the Restricted Isometry Condition with parameters (An, e) 
for e = O-Ol/yTogn. Let v be an n-sparse vector in M. d . Suppose that the measure- 
ment vector $v becomes corrupted, so we consider x = $t> + e where e is some error 
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vector. Then ROMP produces a good approximation to v: 



v — v\\ 2 < 1 04 log rz 1 1 e 1 1 2 • 



Note that in the noiseless situation (e = 0) the reconstruction is exact: v — v. 
This case of Theorem 11.21 was proved in |TT] . 

Our stability result extends naturally to the even more realistic scenario where 
the signals are only approximately sparse. Here and henceforth, denote by f m the 
vector of the m biggest coefficients in absolute value of /. 

Corollary 1.3 (Stability of ROMP under signal perturbations). Assume a measure- 
ment matrix <3> satisfies the Restricted Isometry Condition with parameters (8n, e) 
for e = 0.01/yTogn. Consider an arbitrary vector v in M. d . Suppose that the mea- 
surement vector $t> becomes corrupted, so we consider x = $f + e where e is some 
error vector. Then ROMP produces a good approximation to vm'- 



Remarks. 1. The term t> 2 n m the corollary can be replaced by Vri+g) n for any 
5 > 0. This change will only affect the constant terms in the corollary. 

2. By applying Corollary 11.31 to the largest 2n coordinates of v and using 
Lemma [3.11 below, we also have the error bound for the entire vector v: 



3. For the convex programming method (11.21) . the stability bound (11.41) was 
proved in [3], and even without the logarithmic factor. We conjecture that this 
factor is also not needed in our results for ROMP. 

4. Unlike the convex program (jl.2p . ROMP succeeds with absolutely no prior 
knowledge about the error e; its magnitude can be arbitrary. In the terminology 
of [8], the convex programming approach needs to be "noise-aware" while ROMP 
needs not. 

5. One can use ROMP to approximately compute a 2n-sparse vector that is 
close to the best In-term approximation t>2 n of an arbitrary signal v. To this end, 
one just needs to retain the In biggest coordinates of v. Indeed, Corollary 13.21 below 
shows that the best 2n-term approximations of the original and the reconstructed 
signals are close: 



6. An important special case of Corollary 11.31 is for the class of compressible 
vectors, which is a common model in signal processing, see [5], [6]. Suppose v is 
a compressible vector in the sense that its coefficients obey a power law: for some 
p > 1, the k-th largest coefficient in magnitude of v is bounded by C p k~ p . Then 
(jl.4p yields the following bound on the reconstructed signal: 



(1.3) 




(1.4) 





(1.5) 



v — v\\ 2 < C: 



„ yiogn 

P n p-l/2 



+ C"Vlogn||e|| 2 . 
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As observed in [3], this bound is optimal (within the logarithmic factor); no algo- 
rithm can perform fundamentally better. 

The rest of the paper is organized as follows. In Section [2j we prove our main 
result, Theorem 11.21 In Section [3], we deduce the extension for approximately sparse 
signals, Corollary 11.31 and a consequence for best n-term approximations, Corol- 
lary 13.21 In Section HI we demonstrate some numerical experiments that illustrate 
the stability of ROMP. 

2. Proof of Theorem 11.21 

We shall prove a stronger version of Theorem 11.21 which states that at every 
iteration of ROMP, either at least 50% of the newly selected coordinates are from 
the support of the signal v, or the error bound already holds. 

Theorem 2.1 (Iteration Invariant of ROMP). Assume $ satisfies the Restricted 
Isometry Condition with parameters (4n, e) for e = 0.01/Vlogra. Let v ^ be an n- 
sparse vector with measurements x = $t> + e. Then at any iteration of ROMP, after 
the regularization step where I is the current chosen index set, we have Jq H / = 
and (at least) one of the following: 

(i) |J nsupp(w)| > ||J |; 

(ii) |H supp ( v )\/ 1| 2 < 100Vlogn||e|| 2 . 

In other words, either at least 50% of the coordinates in the newly selected set J 
belong to the support of v or the bound on the error already holds. 

We show that the Iteration Invariant implies Theorem 1 1.2 1 by examining the three 
possible cases: 

Case 1: (ii) occurs at some iteration. We first note that since |/| is nonde- 
creasing, if (ii) occurs at some iteration, then it holds for all subsequent iterations. 
To show that this would then imply Theorem II. 2 \ we observe that by the Restricted 
Isometry Condition and since |supp( , 0)| < |/| < 3n, 

(1 — s)\\v — v\\2 — ||e||2 < \\<&v — $f — e 1 1 2 - 

Then again by the Restricted Isometry Condition and definition of v, 

\\<$>v -$v- e || 2 < \Mv\i) - <$>v- e|| 2 < (1 +e)|H BU pp W \j|| 2 + ||e|| 2 . 

Thus we have that 

,i ^ 1 + £ u I II 2 I, ,1 

\\V - V\\ 2 < :j-3^IMsupp(i,)\/||2 + J^ll e ll2- 

Thus (ii) of the Iteration Invariant would imply Theorem 11.21 

Case 2: (i) occurs at every iteration and J is always non-empty. In this 
case, by (i) and the fact that J is always non-empty, the algorithm identifies at least 
one element of the support in every iteration. Thus if the algorithm runs n iterations 
or until |/| > 2n, it must be that supp(f ) C /, meaning that u| SU pp(u)\/ — 0. Then 
by the argument above for Case 1, this implies Theorem 11.21 
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Case 3: (i) occurs at each iteration and J = for some iteration. By 

the definition of Jo, if Jo = then u = $*r = for that iteration. By definition of 
r, this must mean that 

-y) + $*e = 0. 

This combined with Part 1 of Proposition 12.21 below (and its proof, see [UJ) applied 
with the set I' = supp(t>) U I yields 

\\v - y + {$*e)\ r \\ 2 < 2.03e||u-y|| 2 . 

Then combinining this with Part 2 of the same Proposition, we have 

\\v - 2/ 1 1 2 < l.l||e|| 2 . 

Since u| SU pp(t>)\j — (v — y)\ sup p( v )\i, this means that the error bound (ii) must hold, 
so by Case 1 this implies Theorem 11.21 

We now turn to the proof of the Iteration Invariant, Theorem 12.11 We will use 
the following proposition from [IT] . 

Proposition 2.2 (Consequences of Restricted Isometry Condition [II]). Assume a 
measurement matrix <3> satisfies the Restricted Isometry Condition with parameters 
(2n,e). Then the following holds. 

(1) (Local approximation) For every n-sparse vector v G ffi d and every set I C 
{1, . . . , d}, \I\ < n, the observation vector u = satisfies 

\\ u \i ~ v \i\\2 < 2.03e||v||2. 

(2) (Spectral norm) For any vector z e M. N and every set I C {1, . . . , d}, |/| < 
2n, we have 

H(^)lzl| a <(l+e)Nl3- 

(3) (Almost orthogonality of columns) Consider two disjoint sets I, J C {1, . . . , d}, 
| J U J| < In. Let Pi,Pj denote the orthogonal projections in ¥L N onto 
range($/) and range($j) ; respectively. Then 

11^112-2 < 2.2e. 

The proof of Theorem l2.1l is by induction on the iteration of ROMP. The induction 
claim is that for all previous iterations, the set of newly chosen indices is disjoint 
from the set of previously chosen indices /, and either (i) or (ii) holds. Clearly if 
(ii) held in a previous iteration, it would hold in all future iterations. Thus we may 
assume that (ii) has not yet held. Since (i) has held at each previous iteration, we 
must have 

(2.1) \I\<2n. 

Let r ^ be the residual at the start of this iteration, and let J , J be the sets 
found by ROMP in this iteration. As in [UJ, we consider the subspace 

H := range($ supp( ,,) U/ ) 

and its complementary subspaces 

F := range($/), E := range($ supp ( t ,)\/). 
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The Restricted Isometry Condition in the form of Part 3 of Proposition 12.21 ensures 
that F and E are almost orthogonal. Thus E is close to the orthogonal complement 
of F in H, 

E := F ± f] H. 
The residual r thus still has a simple description: 

Lemma 2.3 (Residual). Here and thereafter, let Pi denote the orthogonal projection 
in M, N onto a linear subspace L. Then 

r = P E &v + P F ±e. 

Proof. By definition of the residual in the algorithm, r = P F ±x = P F ±(§v + e). To 
complete the proof we need that P F ±<&v = P F $>v. This follows from the orthogonal 
decomposition H = F + E and the fact that <&v G H . □ 

Now we consider the signal we seek to identify at the current iteration, and its 
measurements: 

(2.2) v : = u| SU pp(«)\/, := ®v G E . 

To guarantee a correct identification of vo, we first state two approximation lemmas 
that reflect in two different ways the fact that subspaces E and E are close to each 
other. 

Lemma 2.4 (Approximation of the residual). We have 

H^o - r\\ 2 < 2.2e||a;o||2 + ||e|| 2 . 

Proof. By definition of F, we have $w — Xq = $(t> — v ) G F. Therefore, by 
Lemma I2T31 r = P E §v + P F ±e = P E x + P F ±e, and so 

ll^o - r\\ 2 = ||a5 - Pex - P F ±e\\ 2 < \\Pfx \\ 2 + ||e|| 2 . 

Now we use Part 3 of Proposition 12.21 for the sets / and supp(w) \ I whose union has 
cardinality at most 3n by (12.11) . It follows that 

ll-Pp^olb + ||e|| 2 = \\PfPe xo\\2 + ||e|| 2 < 2.2eJ|rc ||2 + ||e||2 
as desired. □ 

Lemma 2.5 (Approximation of the observation). Consider the observation vectors 
Mo = Q*xq and u = $*r. Then for any set Tc {1, . . . , d} with \T\ < 3n, 

\\(u - u)\ T \\ 2 < 2.4e||« ||2 + (1 + e)||e|| 2 . 

Proof. Since xq = &Vq, we have by Lemma [2741 and the Restricted Isometry Condition 
that 

\\x - r\\ 2 < 2.2e\\$v \\ 2 + ||e|| 2 < 2.2e(l + e)|K|| 2 + ||e|| 2 < 2.3e||u ||2 + ||e|| 2 . 

To complete the proof, it remains to apply Part 2 of Proposition 12. 2\ which yields 
\\(u -u)\ T \\ 2 <(l + e)\\x -r\\ 2 . □ 
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We next show that the energy (norm) of u when restricted to J, and furthermore 
to J Q , is not too small. By the regularization step of ROMP, since all selected 
coefficients have comparable magnitudes, we will conclude that not only a portion 
of energy but also of the support is selected correctly, or else the error bound must 
already be attained. This will be the desired conclusion. 

Lemma 2.6 (Localizing the energy). We have ||w|j||2 > . 8 1 1 -i^o 1 1 2 — (1 + £ ) IMh- 

Proof. Let S = supp(f) \ /. Since \S\ < n, the maximality property of J in the 
algorithm implies that 

\\u\jh > \\u\sh- 

By Lemma [2.51 

\W\sh > IKMI2 - 2.4e||v ||2 - (1 + £)||e|| 2 - 
Furthermore, since vq\s — v o, by Part 1 of Proposition 12.21 we have 

\\uo\sh > (l-2.03e)||vo|| 2 . 
Putting these three inequalities together, we conclude that 

Nj|| 2 > (1 - 2.03e)||u ||2 - 2.4e|K|| 2 - (1 + e)||e|| a > 0.8|K|| 2 - (1 + e)||e|| 2 . 
This proves the lemma. □ 

We next bound the norm of u restricted to the smaller set Jo, again using the 
general property of regularization. In our context, Lemma 3.7 of [TT] applied to the 
vector u\j yields 

||w|j ||a > 9 I \\u\jh- 

2.5vlogn 

Along with Lemma 12.61 this directly implies: 

Lemma 2.7 (Regularizing the energy). We have 

,, , ,, 1 , ,, || e || 2 
Hjolla > , A F0II2 



Ay/\ogn 2^J\ogn 

We now finish the proof of Theorem 12.11 The claim that Jo D I = follows by the 
same arguments as in [TT] . 

The nontrivial part of the theorem is its last claim, that either (i) or (ii) holds. 
Suppose (i) in the theorem fails. Namely, suppose that | J fl supp(t>)| < || J |, and 
thus 

|J \supp(w)| > -|J |. 

Set A = J \supp(f). By the comparability property of the coordinates in J and 
since |A| > ||Jo|, there is a fraction of energy in A: 

1 1 II e II 2 

I 2 - 3 ) IpIa||2 > — 7=11^1 Jo II2 > , /r , \\v0W2 



where the last inequality holds by Lemma 12.71 



On the other hand, we can approximate u by Mo as 
(2.4) IhUlb < ||«|a - W0UII2 + Ihoklb- 

Since Ac J, |«7"| < n, and using Lemma [2.51 we have 

Na - W0UII2 < 2.4e||« || 2 + (1 + e)||e|| 2 - 

Furthermore, by definition ( 12. 2ft of t>o, we have Uq|a = 0. So, by Part 1 of Proposi- 
tion E21 

IKUH2 < 2.03e||^ ||2- 
Using the last two inequalities and f|2.4jl . we conclude that 

||w|a||2 <4.43e||uo||2 + (l + e)||e|| 2 . 
This is a contradiction to (12.31) so long as 

0.02 ||e|| 2 



e < 



\Aogn \\v0W2 



If this is true, then indeed (i) in the theorem must hold. If it is not true, then by 
the choice of e, this implies that 

IKH2 < 100||e|| 2 \/logn. 
This proves Theorem 12.11 Next we turn to the proof of Corollary 11.31 □ 

3. Approximately sparse vectors and best ti-term approximations 

3.1. Proof of Corollary 11.31 We first partition v so that x = $i> 2n +$(u— u 2n ) + e. 
Then since $ satisfies the Restricted Isometry Condition with parameters (8n,e), 
by Theorem 11.21 and the triangle inequality, 

(3.1) \\v 2 n-vh < 104yiog2n(||$(w - v 2n )h + ||e|| 2 ), 

The following lemma as in [9] relates the 2-norm of a vector's tail to its 1-norm. An 
application of this lemma combined with (13.11) will prove Corollary 11.31 

Lemma 3.1 (Comparing the norms). Let w G IR rf ; and let w m be the vector of the 
m largest coordinates in absolute value from w. Then 

11 11 ^ IHI 1 

\\W - W m \\ 2 < 7—^- 



Proof. Let /x denote the (n + l)th largest entry of w. If // = then w m = so the 
claim holds. Thus we may assume this is not the case. Then we have 



Iff ~ 9mh < V\\9 ~ 9m\\i\\g - g m \\Z < V 771 ^ 



llfflli ||ffm||i + Hff - ffmlli mn + m/j, 

Simplifying gives the desired result. □ 
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By Lemma 29 of [9], we have 



${v-v 2n )\\ 2 < {l + e)(\\v-v 2n \\ 2 + ± V 



>n 

Applying Lemma 13.11 to the vector w = v — v n we then have 

\Mv~V 2n \\ 2 < 1-5(1 + £)" "'" 

Combined with (13. lft . this proves the corollary. 
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3.2. Best n-term approximation. We now show that by truncating the recon- 
structed vector, we obtain a 2n-sparse vector very close to the original signal. 

Corollary 3.2. Assume a measurement matrix <£> satisfies the Restricted Isometry 
Condition with parameters (8n, e) fore = 0.01/\/logn. Lei t> 6e an arbitrary vector 
in M. d , let x = $t> + e fre i/ie measurement vector, and v the reconstructed vector 
output by the ROMP Algorithm. Then 



2n - hnh < 4:77>/\og 2n(\\e\ 



v - V n \\i 

\V2; 



n 



where z m denotes the best m- sparse approximation to z (i.e. the vector consisting of 
the largest m coordinates in absolute value). 

Proof. Let v$ := v 2n and Vr '■= v 2 n, and let S and T denote the supports of Vg and 
v~t respectively. By Corollary II. 3[ it suffices to show that \\vs — v T \\ 2 < 3\\v s — v\\ 2 - 
Applying the triangle inequality, we have 

\\vs - v T \\ 2 < \\(v s - Ut)|t||2 + ||vs|s\t||2 =: a + b. 

We then have 

a = \\(v 3 - wr)|r||a < \\ v s ~ v T h 

and 

b < ||u|s\t||2 + || («s - £)|s\t||2- 
Since \S\ = \T\, we have \S\T\ = \T\S\. By the definition of T, every coordinate 
of v in T is greater than or equal to every coordinate of v in T c in absolute value. 
Thus we have, 

INsyHh < II^|t\s||2 = 1 1 («s - v)\ T \ s \\ 2 . 
Thus b < 2\\v,s — v\\ 2 , and so 

a + b < 3\\vs — v\\2. 

This completes the proof. □ 

Remark. Corollary 13.21 combined with Corollary 11.31 and (11.41) implies that we can 
also estimate a bound on the whole signal v. 



\v - v 2n \\ 2 < C\/log 2n(j\e\ 



\v - v n \h 
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4. Numerical Examples 

This section describes our experiments that illustrate the stability of ROMP. 
We experimentally examine the recovery error using ROMP for both perturbed 
measurements and signals. The empirical recovery error is actually much better 
than that given in the theorems. 

First we describe the setup of our experiments. For many values of the ambient 
dimension d, the number of measurements N, and the sparsity n, we reconstruct 
random signals using ROMP. For each set of values, we perform 500 trials. Initially, 
we generate an N x d Gaussian measurement matrix <3>. For each trial, independent 
of the matrix, we generate an n-sparse signal v by choosing n components uniformly 
at random and setting them to one. In the case of perturbed signals, we add to the 
signal a d- dimensional error vector with Gaussian entries. In the case of perturbed 
measurements, we add an N- dimensional error vector with Gaussian entries to the 
measurement vector $w. We then execute ROMP with the measurement vector 
x = $f or x + e in the perturbed measurement case. After ROMP terminates, we 
output the reconstructed vector v obtained from the least squares calculation and 
calculate its distance from the original signal. 

Figure [T] depicts the recovery error \\v — v\\2 when ROMP was run with perturbed 
measurements. This plot was generated with d = 256 for various levels of sparsity 
n. The horizontal axis represents the number of measurements N, and the vertical 
axis represents the average normalized recovery error. Figure [1] confirms the results 
of Theorem 11.21 while also suggesting the bound may be improved by removing the 
y/logn factor. 

Figure [2] depicts the normalized recovery error when the signal was perturbed 
by a Gaussian vector. The figure confirms the results of Corollary 11.31 while also 
suggesting again that the logarithmic factor in the corollary is unnecessary. 
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Figure 1 . The error to noise ratio ,| 2 as a function of the number 

\\ e h 

of measurements N in dimension d = 256 for various levels of sparsity 




Figure 2. The error to noise ratio [uz^rfrj^ using a perturbed sig- 
nal, as a function of the number of measurements N in dimension 
d = 256 for various levels of sparsity n. 
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